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Abstract 

Academic psychology has long been composed of two disciplines, one 
-experimental and one correlational* These two disciplines each developed 
their own method of studying structure in data: multidimensional scaling 
(MDS) and factor analysis. Both methods use similar kinds of input data,- 
proximity measures' on object pairs. Both represent the objfect structure 
in terms of sp atial c oordinates . When MDS and factor analysis are applied 
to the same test interco^relation matrix, how do the results compare? -In 
~3n analysis of ability data and an' analysis of vocational interest data, two 
dimensional, nonmetric MDS solutions were compared to three- factor , prin T 
cipal components so luti o^ In both analyses, the components solution 
contained a general faqtor with no counterpart am&ng the scaling dimensions; 
Loadings along the remaining two components closely resembled sca^e values 

alpng'the two dimensions. Results suggest that if one compares a K-dimen- 

vi- 
sional MDS solution to a (K^* 1), components analysis, the components 

analysis will often contain a general factor with no counterpart among the 
scaling dimensions;" after applying an appropriate rotation and multiplica- 
tive constant to the MDS 'scale values, some or all of the remaining 
components will correspond to a dimension in the scaling splut ion. 
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Twenty-four -years ago,' Lee Crohbach delivered his Presidential address to the 

i 

American Psychological Association, an address Entitled "Jhe two disciplines of 
scientific psychology." In that address, Cronbach pointed to a schism in 
academic psychology between the experimental and correlational traditions. 
Cronbach described the experimentalists as psychologists who employ the experi- 
mental method to bring variables under tight control. This control permits 
"rigorous tests of hypotheses and confident statements about causation." 
(Cronbach, 196^, p. 23) In contrast to the experimentalists, the correlational 
psychologists "study what man has not learned to control or can never hope 
.to control". 

Not only did , the twp disciplines develop their own measurement methods, each 
developed its own statistical technique for studying structure. Correlational 
psychology developed factor analysis. Multidimensional scaling is largely a 
creature of experimental psychology. 

* *' * ' 
Th^ main purpose of my talk today is to compare factor analysis and multi- 
dimensional scaling as statistical techniques for studying the structure "of 
psychological tests and test items. Specifically, I want to illustrate how a 
factor analysis 6f test (or item) intercorrelations oftefl compares to a multi-< 
dimensional scaling of the same intercorrelations. Before making this Compar- 
ison, however, permit me a smaH^iversion into a discussion of parallels 
between the two techniques. These parallels have made^f actor analysis .and 
multidimensional scaling rival alternatives for the study of Structured; 
'psychology. ' v 
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Parallels between Factor Analysis and Multidimensional Sdaling 

There are at least three kinds of parallels between factor analysis. 

and multidimensional scaling; parallels in their historical developments, 

parallels in the -way they represent structure, and parallels in the purposes I„ 

which they have served., Let* 1 s consider each of these parallels in turn be- 

ginning witfi the historical. 

Neither factor anelysis\nor multidimensional scaling began asj^statis- ^ 

tical techniques per se. Both jnethods grew put of attempts to estimate the 

•parameters in some psychological theory. Only later did these parameter 

estimation techniques manage to separate themselves from the psychological 

* ' 

i 

theories of their origins to become statistical! theories in their own right. 

_ s - * 

Before factor analysis, there were factor theories of human abilities, such 

s 

as that of Spearman (1904), Vernon (1950), and Thurstone (1938). Factor 
analysis began as a method for estimating *the parameters in these factor 
theories. After awhile, it became a statistical technique applicable not just 
to the study of human abilities, but to phenomena in all. the behavioral, social, 

— • V ' 

and natural sciences. . 

« 

"Similarly, before there was multidimensional scaling, Richa-rdson 1 (1938) 
proposed' a distance model for psychophysical judgments of similarity between 
pairs of stimuli. Young and Householder (1938) developed a method to estimate - 
the parameters in Richardson's psychophysical model. Other people expanded 
on their parameter estimation method tintil it developed into what we now ^ 
call multidimensional scaling. /• < 

* v. 

The parallels between the two methods go beyond t the historical ones. 



■ERJC 



Both techniques use the same kind of input dat;a, measures of proximity on 
pairs of objects. The 'correlation coefficient is the overwhelmingly favored 
proximity measure for the factor analysts. Although multidimensional scaling. 



advocates do not so consistently favor one proximity measure, nevertheless, 

* 

they like the factor analysts must use some measure of proximity .or &ssa- 

ciation between object pairs as the input to their analysis. 

Not only do^ the -methods use comparable input data, they yield parallel 

representations of structure. That is, both techniques yield a representa- 

* i 

tion of structure in terms of spatial coordinates. Factor analysts call 
their coordinates 'factor loadings' and multidimensional scaling advocates 
"call their coordinates 'scale values.' t ' 

Given the above parallels, it is not surprising to find that 'the two 
methods have fieen used to study many of the same issues in psychology. 
Social psychologists have used both factor analysis and multidimensional 
scaling to study the social dimensions underlying person perception (Jone & 
Young, 1972; Rosenberg & Jones, 1972; Taguiri, 1958). Industrial/organiza- 
tional psychologists have used the two techniques to study dimensions of 
/ job performance (Borman, Houghj & buftnette, 1976; Smith & Siegel, 1967). 

Educational psychologists have use3 the two to study the structure of human 

( 

abilities' (Schlessinger & Guttman, 1969). ~* 

When factor,, analysis and multidimensional scaling are used to study 
the same issue, how do the results compare? Particulary', when the two 
methods are used to, study the intercorrelations of tests, how does the 
factor structure compare to the multidimensional scaling? 

; , 

Prior Comparisons of Multidimensional Scaling and Factor Analysis 
Other people have compared multidimensional scaling and factor analysis 
(MacCallum, 1974;. Schlessinger & Guttman, 1969; Shepard, 1972). One con- 
elusion appears several t^imes in these, comparisons^ multidimensional scaling 
solutions tend to be simpler than factor solutions- That is, the number 

of dimensions in scaling .solutions tends td be less than the number of 

/ * . * • / 

y factors in factor solutions. 



Shepard (1972) has concluded that multidimensional scaling solutions 
tend to be simpler in the manner described. In his compariso^i of the two 
techniques, he emphasizes that in nonmetric multidimensional scaling, a 
small number of dimensions offen suffices to represent the Structure of the 

* 4 . * * 

data. Further, he notes that ten or more factors -are extracted in some 
factor analytic studies* "Such results* cannot, of course, be cast into a , 

readily'visualizable picture. This matter of dimensionality and'hence . 

> V 
visualizability tends, in practice, to distinguish these relatively new 

methods of multidimensional scaling from the related methods that have long 9 

been used in the social sciences under such names as 'factor analysis' ^ and 

'principal components analyses ' (Shepard, 1972, pp. $,3) Schlessinger 

and Guttman (1969) d raw much the same conclusion. 

If multidimensional scaling solutions really are simpler than factbr 

solutions, then how is this simplicity- achieved? Do tile scaling dimensions 

somehow represent all of tfifc J-mpo^tant- structure in a set of tests? Or 

do the scaling dimensions oversimplifyLthe structure of the tests (or test 

items) by omitting important features of the structure? If the latter la* 

'A. * 

ttue, then the more complex factor structure may better represent the rela- 

■ T 

tionships between the tests tTian does the simpler, multidimensional scaling 

^_ . „ — y 

solutions. 

The next two sections of thi£ paper present factor and multidimensional 
pealing analyses of the same data so th_at we 'can compare ^the two. In com- 
paring*them, we should keep in mind the broad question: '''what is the rela--^ 
tionship between a multidimensional scaling and factoring of the same test 
1 intercorrelations? .We should also keep-in mind a second question raised by 
Shepard 1 s '(1972) work: ' ' 



if the multidimensional scaling is simpler, is that simplicity achieved, in 
part, by* omitting important features of the test structure which are contained, 
in the factor loadings? 

* » 
, ' Human Ability Tests . 

t " > 

Let's begin the empirical comparison of factor analysis and multi<Ji- • 

mensional scaling by examining some data from the field in which factor ana^- 

3 

« 

ysis has its roots, the^field of human abilities. For the Ability data' to 

be shown below, there is an interesting correspondence between the three- 

r 

dimensional, principal components solution and the two-dimensional, nonmetric 
multidimensional scaling solwifcon. * 

Table 1 shows the intercorrelations of twelve subtests front the General 
Aptitude Test Battery (United states Government Printing Office, 1970) 
published by the U.S. Department of Labor. , The subjects were 168 clients 
in the Vocational Assistance Program of the Minnesota Department of Voca- ' 
tional Rehabilitation. 

Table 2 shows the first three unrotated components from a principal 

* ' ** ♦ 

components analysis of these data.- It also shows the scale values from a 

^\ 

two-dimensional, nonmetric analysis of these same correlations (Kruskal, Young , 
& Seery, 1973). ; 

y * ' , - 

The first principal component is a genreal .factor .along which every sub- — 

% . 

test has a relatively high, positive loading. It has no counterpart among , 
the two scaling dimensions. That* is, there is no f scaling dimension on which 
all tests have high, positive sqale values. Both scaling dimensions are bi- 
polar; some tests'have positive scale values' and some tests have negative ones. 

UnliKS the first principal component, the second component ii> these^ data 
does have a counterpart among the "scaling dimensions. . If . you compare each factor 
f loading- along Factor II to the corresponding scale value along Dimension I f - you 



c 



Subtest 



Table 1 

Pearson Product-Moment Correlation Coefficients* 
'for the General Aptit.uda Test Battery 



I 

6 7 



8 



10 11 12 



1< NAMES 

2 ARI^H 

. 3 3 t D 

4 VOCAB 

5 TOOLS 

6 MATH 

; SHAPES 

■ \ 8 . MARKING 
i 

. 9 PLACE 

10 TURN 

* 

11 ASMBL 

12 DISASMBL 



697 -.360 637 586 552 '496 661 338 349 . 390 354 

366' 580 471 760 411 501 297 247 319 325 

* / 558 <t ^54 468 580 249 27~6 279 358 234 

425 616 444 465 211 209' ' 267' 283 

369 531 444 v 292 336 361 267 

400 407 300 234 208 311 

387 323 40^ 444 428 

■ ' * 494 ' 540 439 422 . 

•773 468 453' 

I. s 476 482 

♦ 

• 676 



*decimal points.* deleted. I am indebted to Stephen Prestwood for bringing 
these correlations to my attention.. 
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Table 2 



Factor Loadings £nd Nonmetric S.cale Valyes 
for the General Aptitude Test Battery . 



Subtest 



Factor 
I 



Dimension 



Factor 
II 



Dimension 

s 

II- 



NAMES * .785 

ARITHMETIC . 742 

3-D .635 

VOCABULARY ' .700 

TOOLS • • .691 

MATH ' *694 

SHAPES .712. 

MARKING .723 

PLACE .620 

TURN . 633 

, ASSEMBLE . .646 

i 

DISASSEMBLE . 624* 



1 



-.191 
-.349 
-.385 
-.476 
-.274- 
-;435 
-.079 
.147 
.566 
',527 
.415 
.535 



-.255 
,381 
232 
436" 
171' 
422' 
032 
150 
546 
585 
437 
433 



-.'129 
-.277 

.403-' 
-.101 

.253 
-.284 
, .329 
-.264" 

-:28i 

-.161 
.280 
.233 



will see that -every one of those loadings is of the same' sign and 'approximately 

the same magnitude as the corresponding scale value* • „ 

Sipilarly, the third principal component has its counterpart among the 

scaling dimensions. If you compare each loading along Factor HI to the 

corresponding scale value along Dimension II? you will see that all of the load- 

ings are of the same sign and of approximately the same magnitude as the. cor- 

» « . 

responding ' scale value. • • . t 

One can. compute* a coefficient of congruence for, the two" dimensions and 4 . 

• 1 / 

the corresponding two factors. In the present case, that -congruence coefficient 
is simply thf*. correlation l^|twjeen the 24 scale values along Dimensions I and 
II and the corresponding 24- |Loadings along Factors II and III. The congruence 
coefficient e^uals*..96 and indicates that there is a -high degree of correspon- 
dence between the dimensions and the second and third principal components. 

9 

Figure 1 graphically displays the relationship shown in Table 2 between . 
Dimensions l and II of the scaling- solution and Factors "II and Til of 'the com- 
ponents analysis.' In this figure, squares represent subtest scaler values. .For 
each squarfe, the coordinate along the horizontal axis represents the Dimension 
P scale value of the corresponding subtest. The coordinate along the vertical 
axis is the Dimension II scale value*. Circles in Figure' 2 represent subtest 
factor loadings. The coordinate along the horizontal axis is the factor ^11 
loading for the corresponding 'subtest . The coordinate along the vertical gxfis 
is the Factor ILI loading. For each test, an arrow connects the .square rep # re- ^ 
senting its scale values to the corresponding circle representing its factor 
loadings.. This- graph shov/s'that the Factor ,11 and III loadings -(the circle) 

ft 

place each subtest- in approximately the same region of the sTpace as "do its 

\ 

Dimension I and II sclale values (the-square) . s 



V. 
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-F^CtOr III 

Dimension %I 




3-D 



Shapes 



Tools 



Vocabulary 



/ 

Names 



Math 



Arithmetic 



0 




/ Disassemble 



Factor II 
Dimension I 



\ 



Turn 

\ Place . 



Marking 



\ 



• ' Deno'tes* Scale Values 

* Demotes fiacto'r Leadings 



Figure It Scale Values and Factor Loadings for the General Aptitude Test kattery . 
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Table 2 and Figure 1 illustrate what may be a common, but not "universal, 
relationship between a multidimensional scaling and factor ^analysis of the 
saine data. If one compares a (K. + l)-dimensional factor analysis to 'a K T di©en- 
sional multidimensional scaling solution, then with a proper rotation of the 
two solutions, one^ can find ^general factor which has no counterpart inf the 
scaling solution; beyond the general factor, however, each major factor will 
have a counterpart among the scaling dimensions* 
* ' Occupational Interest Tests 

Outside of the area from which factor analysis emerged— the study of - 
human abilities— the general factor has not always played such a theoretical- 
ly prominent role. In theories of personality, attitudes, k aiid interests, 

> ■ * * * 

•where the supporting data are heavily based on self-report questionnaires, i 

the general factor has sometimes been dismissed aS a theoretically -uninterest- 

ih£, response level factor. In fact one can find factor studies in which the 

general facto* isn' t even reported. Consider this quotation from a study of^ 

self-reported occupational interests by Hanson, Prediger, and Schussel. '(1977) 

Not gjiown. .-. is a general factor common to interest inventories using 
tesponse* categories such as "like, 11 .'"indifferent," and "dislike". ^ 
When such. categories are used, the frequency with which a particular 
response is* chosen tends to vary from person to p'erson, regardless of 
item content. • "^hat is, some persons tend to choose "indif f erent" more 
of ten, retc; Hence, there is a general response-related factor affecting 
tKe scores on each scale. The chief identifying feature of this factor, 
to be called the "response level- factor," is that all interest scales - 
have relatively 'high loadings on' it. (Hanson et al., 1977, p; 20, ^ 
italics added) 

As the first line of this quotation indicates, these author accorded so little 
import, to the general' factor that they- decided to omit it from their ^ tables of 
factor loadings. As we shall see below, it is precisely this general factor 
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REALISTIC 

l « 

investigative' 
artistic 

SOCIAL 

ENTERPRISING 
CONVENTIONAL 



[ 



Table 3 

IntercOrselations of the Vocational Preference 
. Inventory Scales for a Sample- of 1234 men 



R * 
1.00 
.46' 
.16 
.21 
.30 
.36 



I 1 


A 


S 


• * 

E 


C 


.46 


. .16 V 


.21 


.30 


.36 


1.00 5 


.34" . 


.30 


.16 


'.16 


.34 


• • 'loo/ * 


.42 


.35 


.11 


.30 , 


< * .42 > 


1 

i:oo 


.54 


• .38 


•J6 •'■ 


« 35 


.54 


1.00 


.68 


. .16 


.11 


' .38. 


.68 

i 


,1.00 



which is missing. in a multidimensional scaling solution based on data of the . 
kinj analysed by flanson et al . 

Table 3 shows the kind of data Hanson et al. analyzed in the report from, 
which the above quote was taken,. These are the intercorrelations of six sub- 
from* Holland's" (1965) Vocatiftial P^erence Inventory (VPI): Jhe 



tests 
• 



/ f 



< 

VPI contains six scales, each of which corresponds to a type of occupation 
in Holland's (1973) thectry of careers. The six scales, which are named • ■ 
after the six occupational types, ate called the Realistic; Investigative, 
Artistic, .Social, Enterprising, -and Conventional scales. Table 3 shows 
the intercorrelations of the six sckles in a sample of 1234 men (Holland, Whit- 

ney, Cole, & Richards, 1969). This is one of five such correlation matrices - 

> i 

analyzed fin a study by Rounds, Davison^ and Dawis (1979). 

Table 4 -shows the first three unrotated component^ from a principal 
components analysis of these 'data. It also show^ the scale values from a two- 
dimensfonal, -nonmetric analysis of these*same correlations • (Kruskal, Young, 



& Seery, 1973). < ' | ' 

The first principal, component is the general factor to which the quotation 
above refers, and 'it displays the distinctive feature described in that quo7 
tation-r u all interest scales have relatively high loadings on it;." (Hanson. et 

\ e 

al., 1977, p/ 20) This general factor, which Hanson ej: _al,."*'(1977) chose nQt*' 
fo report, has no counterpart in the multidimensional scaling dimensions. 
That is, there is no 'scaling dimension on whifch all tests have high, positive 
scale values. Both scaling dimensions- are bipolar; some tests have positive - 
scale values and some tests have negative ones. 

Unlike the first .principal component, % the second component in these data* 
i^oes have a counterpart among the scaling dimensions. If you compare each 
loading along Factor II to the corresponding scale value along Dimension I, 
you will See that every one of those loadings is of the same sign and approx- 

imately the same magnitude as the^ corresponding scale value. * 

* ' 
* Similarly, thfe third principal component has its counterpart among the 

scaling dimensions, 4 If you compare each loading along Factor Jill to the 

9 * f T 

corresponding scale value along Dimension II, .you will see that all but one 

< • t t ■ * 

of. the loadings artf of the s^me sign^ and approximately the same magnitude as 
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SCALE 

REALISTIC 
INVESTIGATIVE 
ARTISTIC 
\ SOCIAL 
ENTERPRISING 
CONVENTIONAL 



Factor Loadings and Nonmetric Scale Values 
for the Six Vocational Preference Inventory 1 

Scales 



Factor 
I 



: 595 
.555 
f 568 
.736 
.803 
.711 



Dimension 
I 



.369 

.133 
-.236 
-.492 
-.456 



Factor 
II 



.324 
.685 
.335 
-.080 
-.437 
-.496 



Dimension 
I 



.491 
• .061 
-.696 
-.294 
.020 
.418 



f 



actor 



III' 



• .598 
.158 
-.607 
-.371 
-.055 
.307 



1 < 
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Factor III 
Dimension II 




r 



K 




Factor II 
Dimension I 



B Denotes .Scale Values 

4 " * * 

• Denotes Factor Loadings 



Figure 2. Scale Values and Factor Loadingis for the Vocational Preference Inventory 
, Scales / / ^ 

17 » ' 
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the corresponding scaie value. 

As in the first' example above, one can compute a congruence coefficient for 
the two dimensions and the second and third "principal cotiiponents. That coef- 
ficient equals .97 and indicates that there is a high degree of correspondence 
between the 12 scale values along Dimensions I and II and the 12 loadings along 
Factors II- and III. ■ ' 

Figure 2 graphically displays the relationship shown in Table 4 between 
Dimensions I and II of the scaling solution and Factors II and III of the 
components analysis. As in the earlier figure, squares represent subtest 
scale values, and circles represent subtest factor loadings. For each t^st, 
an arrow connects the square representing its scale values to fhe correspond- 
^ % • ing circle repKsenting its factor loadings. This graph shows that the Factor. 
• II and III loadi\s (circles) place each interest subtest in the same region 
of the space as do its Dimension I and II scale values. Readers familiar with 

Holland's (1973)" theory will recognize that the six squares, (and thfc six 

-» ^ > 

circles) form -the corners of a .roughly hexagohal configuration, and the points 
/ v f a n along the hexagon in the order predicted by Holland's theory. ( • * 

In Table 4 and Figure 2, we see the same kind of relationship between the ? 
» multidimensional scaling, and factor analysis that we saw in the earlier analysis 
of human ability data. That is, the first principal component has no ^counter-, 
part in the scaling solution. Each component beyond the first, however, 
does have a counterpart among, the multidimensional soling dimensions. , 

\ 

Discussion / 
v At this point, I must explain how the MDS scale values were obtained in the % 

two examples. Two MDS dimensions were extracted tising Krtiskal, Young, and ' 1 

*Seery's (i973> nonmetric MDS program KYST. The program rotated the two dimen- 

tit f> 
sions to what ltd authors call a principal components orientation. I then 

reflected dimensions as necessary so that the signs of scale values would more 

. . ^ ■ is ' ; ■ • 

' 1 ' • * * • * 
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closely approximate those {tf the corresponding 'factor loadings. Finally, 

1 performed a uniform shrinking of thfc MDS dimensions. ' That is, the scale 

values were multiplied by a constant which was chosen so that the sum of 

squared scale- values along Dimensions I and II would equal the sum of squared 

v factor loadings along the second and third principal .components. >, 

This multiplication of the scale values by a constant is permissible 

* * — 

because the origin and unit* of measurement in a MDS are arbitrary. In factor 

analysis, on the other hand^, the unit and origin for the loadings' are fixed. 

Because they are fixed, the squared loading for a test can be interpreted as 

the proportion of- variance in the test which is accounted for by the factor. 

No such proportion of variance interpretation can be made of the MDS scale 

values," because the unit and origin of those scale values are arbitrarily set. s 

Returning to the earlier examples, the GATB and" VPI analyses, those 

analyses suggest the following two relationship Sj between a MDS in K dimensions 

and a principal components analysis in K+l factors. First, the components 

. analysis will often contain a general factor with no 'counterpart among the 

* scaling dimensions. Second, after applying an appropriate rotation and multi- 

plicative constant to the MDS scale values, some or all of the components be- 
1 ■ ' ' A 

yond the } first will have a counterpart in the scaring solution. , - 

Thq above two relationships deserve several caveats. # In the interest 

of- time, however, I will present only two. First, the above examples are only 

♦ * * 

suggestive. I dcTnot know how generally they hold. The geiierality of these 

two relationships deserves further investigation. % 

Second, the relationships can: be expected to hold only when MDS and factor 

analysis are used to analyze the same intercorrelabion matrix. Many of nqn- 

*metric M&'S's advantages arise" from the fact that it can be used to analyze- data 
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-for which conventional factor analysis is not considered appropriate. Re- 

searchers using MDS have often employed very different experimental procedures 

\ • , > . 

and have often analyzed very different data from those employed by factor analysts 

examining the same research question. The above relatiQtiships cannot be ex- 

pected to describe the correspondence between a MDS and a factor analysis which 

are based on vastly different proximity data. - - 4 , 

Within the limits set by these caveats, however, the above examples do r 



suggest a correspondence between MDS and principal components apalyses of^he 

h ' ' l 

same test or test item inter correlatipns. *The factor solution is often more 

* * \ 

complex, in part because *it contains a general factor with no counterpart among 

& . *\ 

the scaling dimensions; In human ability data/ the general component is some- 

times called /the general ability factor, 'and it has played a central role in 

several theories of human abilities. In Self-report data, the general^ factor 

is sometimes called a response^ level component, and it has sometimes been totally 

» ignored in reporting factor .results. When the general factor is important, 

MDS omits a central feature of the test structure. When it is inconsequential;' 

however, MDS may provide a simpler representation of the test structure which 

preserves i all of its essential aspects. 9 \ . 



9 * 

ERIC '2V 
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